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ABSTBACT 


This  report  describes  research  that  has  beca  conducted  to 
deteraiao  the  relatioBshipt  among  scores  on  a Hth  lety  of  aptitude 
tests,  standing  in  Basic  Enlisted  Submarine  School,  New  London,  and 
subsequent  pettommee  aboard  submarines  a^  measured  hy  ratings, 
written  test  Ff  a Job  sample  tests. 

The  interrelationships  of  the  several  shipboard  performance 
measures  are  described  and  the  resuKa  of  a factor  analysis  of  the 
intercorrelatiotts  of  aptitude  test  scores  and  Submnrine  Sehod 
criteria  are  presented. 
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Chapter  1 

SCtWARY  ANG)  OPERATIONAL  QiPLICATIONS 

Rsteareh  h»f  b»e*«  wndneted  ts  dstersis-  the  extest  ts  shich  shipbesrd 
eiritericR  measures,  drrslcped  during  earlier  pUise*  of  this  crer«aii  stud;# 
predictable  fro«  Subnariae  School  standing  and  from  a variety  of  aptitude  tests 
adMiaiatered  to  enlisted  personnel  upon  entrance  into  the  Basic  Submarine  School* 
The  shipboard  measures  included  Job  sacqiie  tests,  ratings  general  traits,  rating: 
an  specific  technical  tasks,  and  written  job  knowledge  tests. 

In  addition,  the  extent  to  which  the  Suboierine  School  criterion  was  pre- 
dictable from  the  same  aptitude  test  scores  was  determined  and  a tentative  identi- 
flcitlun  of  some  of  the  basic  variables  in  that  criterion  was  made  through  a 
factor  analytic  study. 

From  the  results  of  the  study,  the  foHowlng  cor, elusions  end  <fpp!ic^s*ions  are 
drawn: 

1.  Perfortaance  in  Submarine  School  is  highly  predictable  from  a combi- 
nation of  sooTO^  n»i  N»ifw  l^r.T  ART  owft  ¥•»•»*•«,< 

V 

teats  and  a test  of  the  Direction  Marking  type  used  in  this  study, 

2.  Factor  analytic  result?  suggest  that  there  are  at  least  three  major 
factors  ia  the  Submarine  School  criterion  thet  are  identifiable 
from  aptitude  test  results: 

a)  Mechanical  knowledge  or  comp re.^hens Ion 

b)  Numerical  facility 

c)  A vradao  rsetor,  whicii  may  reflect  RCadwisc  motivation, 

3.  Measures  of  shipboard  porformence  ace  e.lso  prsdlctEble  to  a reason- 
able degree  primarily  by  Mechanical,  Numerical,  Reasoning,  Direction 
Marking  and  Visual  Attention  tests  ia  various  coabinstioRS, 

AuvmsI  tests  oi  performance;  such  as  Job  Sm^ls  tests,  appear 
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to  be  Bore  predictable  than  ratings  of  abilities  to  perfornj  specific 
tasks,  ratings  on  general  tracts  pertaining  to  Job  knowledge,  or 
written  Job  Knowledge  tests, 

^boiarine  School  standing  has  a moderate  relationship  to  subsequent 
shipboard  performance,  particularly  the  more  technical  aspects  of 
that  performance.  (It  was  not  related  to  scores  on  Personal  Ad» 
justment  traits  in  the  rating  scale.) 

Satinas  on  general  trsits  uslcg  s man-to*«=r.  type  rating  scale  have 
tome  validity  for  subsequent  shipboard  perf^’^^ance  as  measured  by 
Job  Sample  tests.  This  is  true  of  the  traits  oviented  toward  the 
technical  competence  aspect  of  performance.  It  is  very  likely  more 
true  of  certain  rates  aboard  ship  than  of  others.  In  addition, 
tho  rating  soalo  yielded  a great  deal  cf  relisble  varianca  vmich 
appeared  to  be  non**technieal  in  nature  and  which  is  characterized 
by  a Blanks  attitude  toward  his  Job  or  his  adjustment  to  shipboard 

V • « 

A A A «a 

Ratings  on  a specific  technical  check  list  ratine  scale  have  Rome 
validity  for  shipboard  performanee  as  measured  by  Job  S&Tiple  testa 
but  do  not  appear  to  have  a clear'*cut  advantage  over  mors  general 
trait  ratings  such  as  al  tJie  M and  %S.  ImSife- 

sbogj, . Raters  do  not  appear  to  know,  with  any  great  certainty, 
vdtether  or  not  their  men  can  actually  perform  eertais  specific  tasks 
At  the  lower  pay  grads  levels  it  is  thought  thst  It  i?  oftsa  d!£“ 
ficult  for  a rater  to  isolate  ths  contribution  of  one  man  against 
those  of  others,  particularly  when  the  men  typically  work  In  gangs 
and  or.  complex  equipment. 

The  fact  that  the  specific  check  list  ratings  and  the  more 


geaeral  trait  ratings  correlated  higher  with  each  other  than  with 
any  other  Measure  suggests  that  the  check  list  ratings  may  not  be 
yielding  any  more  in  the  way  of  rslid  iaforsaticn  than  would  be 
obtainable  from  the  more  general  rating  scale*  An  argument  against 
this  conclusion,  however,  is  provided  by  the  fact  that  cheek  list 
ratings  are  somewhat  more  predictable  by  aptitude  test  scores  than 
are  ratings  on  general  traits. 

7,  Scores  on  a Written  Job  Knowledge  test  do  not  appear  to  be  a satis- 
factory substitute  for  measures  of  Job  skill  as  revealed  in  Job 
Sample  test  scores.  The  reason  for  the  relative  independence  of 
Written  Job  Knowledge  test  scores  and  Job  Sample  Performance  test 
iooret  on  the  one  hand,  and  of  the  various  sub-tests  in  a Job 
Sample  PerfomiaRce  test  battery  on  the  other,  needs  further  investi- 
gation. The  relative  extents  to  which  general  skills  end  specific 
knowledges  are  important  for  effective  performance  aboard  a sub- 
ma.liic  wtttt  nos  Clear  rrom  this  study. 

8,  An  appreciable  voount  of  non-techalcal  f ; -rcrcr.t  i.“. 

measures  of  performance  sbcsrd  submarines  when  ratings  are  used. 

The  nature  of  this  variance  and  its  possible  predictability  would 
appear  to  warrant  considerable  study. 
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ChaptciT  II 

I«T?>ODUCTICK  TO  TKE  ?KO^Em 


This  report  is  concerRod  with  the  question  of  the  extent  to  which  aptitude 
tests,  adMiaistered  to  trainees  at  the  Basic  Enlisted  Submarine  School,  New  London, 
were  predictive  of  subsequent  perfonsance  aboard  submarines  as  measured  by  the  job 
cariple  tests,  rating  scales  and  check  lists.  Additionally,  since  performance  in 
Submarine  School  was  avaiiabie  cs  an  iiSnedlate  criterion,  the  extent  to  which 
aptitude  test  scores  predicted  it  and  the  extent  to  which  it  predicted  the  ship-' 
board  cvitorion  measures  also  was  determined. 

The  performance  of  submarine  personnel,  particularly  during  time  of  war, 
offers  a cliallenge  to  psychologists  and  medical  specialists  who  would  try  to  pre- 
dict bdiavior  which  undoubtedly  reflects  a combination  of  technical  and  highly 
sp&ciallzen  skills  oq  one  hand,  and  personal  adjustment  to  a unique  social  and 
physical  environment  on  the  other. 

The  efforts  of  this  project  were  directed  toward  the  development  of  KuftMhiA 
measurements  of  performance  aboard  submarines  which  might  be  ust^  to  evaluate  the 
orecedures  in  tne  screening  of  enlisted  personnel  on 

subiaarir.$». 

A difficult  problem  arises  in  assessing  the  adequacy  of  the  criterion  measures 
that  eve  developed,  The  very  fact  that  criteria  of  performance  aboard  ship  are 
needed  implies  that  there  are  no  available  standards  of  performar.ca  against  idiieh 
the  criterion  measures  that  are  developed  can  themselves  be  evsluated.  The  uliiaate 
critsrisn  of  the  perforaance  of  submarine' personnel  is  the  reduction  in  striking 
Bfiwar  nf  eneay  forces.  Certainly  B«ch  a criterion  has  severe  limitations  from  the 
point  of  view  of  aeasureaeni  in  addition  to  its  general  lack  of  availability.  The 
various  intermediate  criteria  that  might  be  developed  require  evaluation  but  elude 
direct  aorrelation  with  wsr  affoctlveaess.  In  such  a situation,  and  it  is  typical, 

ww  ^ t* 


there  eppear  to  be  at  least  four  questions  which  should  and  can  be  answered  In 
eviluatittQ  the  relevance  of  the  criterion  aeasures  developed: 

It  Do  operating  persssaei  consider  the  aeasures  to  be  reiiitiveiy 
eoB^lete  indices  of  the  really  isnpurtejit  aspects  of  perfornanee? 

Do  the  measures  reflect  differences  vifaieh  are  known  or  presumed  to 
be  present  in  personnel  of  differential  experience? 

3.  Are  the  measures  reliable? 

4,  Do  predictive  measures,  which  are  loolcallv  related  to  the  criterion 
measures,  actually  correlate  with  them? 

Other  reports  In  this  series  have  descrilbed  the  develcpment  and  seasursmsr.t 
characteristics  of  the  several  shipboard  performance  measures  developed.  These 
were: 

RESEARCH  ON  THE  DEVELOPMENT  OF  SHIPBOARD  PERFORMANCE  MEASURES 
Fart  I;  The  Use  Of  Practical  Performance  Tosts  In  The 
Measurement  Of  Shipboard  Performance  Of  Enlisted  Naval 

/Mn,.  vnen\ 
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• ASS  AISV 


Measurement  Of  Shipboard  Performance  01  Enlisted  Naval 
Personnel,  (Feb,  19545 


Part  III:  The  Use  Of  Performance  Check  Lists  In  The 

Measurement  Of  Shipboard  Performance  Of  Enlisted  Naval 
PeriOnnel,  (Feb,  1934) 

Part  IV:  A noaparifos  Between  Rated  And  Tested  Ability 

To  Dtj  Certain  Job  Tasks.  (Feb.  1954) 


1b  these  reports  informaties  was  presented  to  indicate  that  the  measures 


developed  did  have  the  characteristies  dautaiided  by  the  first  three  questions: 

<i)  they  were  accepted  by  operating  personnel  as  relevant  and  iBg)ortant;  (2)  their 
scores  were  highly  related  to  differential  experience:  (3i  they  were  highly 
reliable. 

the  purpose  of  this  report  is  to  answer  the  fourth,  and,  froas  the  stanupoint 
of  utility,  moat  important  question:  what  was  the  extent  of  the  correlations 
between  the  criterion  measures  and  certain  predictors,  which,  on  a logical  basis, 
should  be  related  to  them? 


Chapter  111 

SUBJECTS,  TESTS  AND  CBITE8IA 


UWfilllfiUgH 

Begiaaittg  in  the  Fall  of  194B  ud  eoetinuing  for  over  two  Teart,  16  aptitude 
teati,  eo!t  ef  ^!eh  were  wall  known  pubilahed  tei^a,  were  adainiatered  to  Members 
of  each  incoming  class  of  the  Basic  Enlisted  Submarine  School  at  New  London, 
Cnnseeticssto  Auproxinaieiy  55a  of  all  incoming  personnel  took  the  tests  during 
this  period.  Testing  was  accosiplished  during  the  days  preceding  the  convening  of 
a Submarine  School  class*  Since  some  men  did  not  reoort  for  duty  until  the  dsy  ss 
which  classes  actually  eomeenced,  not  all  men  in  a given  class  were  available  for 
testing.  Other  thaa  this,  there  was  no  selection  of  subjects,  all  men  arriving  at 
the  station  prior  to  ecnnenceaent  of  the  clast  beiag  tested. 

Testing  was  aeeompliched  by  a research  staff  member  (civilian)  and  by  a Chief 
Petty  Officer  attadied  to  the  school*  The  tests  were  adMialstered  to  men  in  groups 
of  up  tq  90,  Testing  time  for  the  battery  was  aoDroximat 
was  given  midway  during  the  testing  period, 

§llzlfi£U 

The  vast  majority  of  subjects  were  .f^n-reted  ealisted  personnel  vdto  were 
relatively  homogeneous  with  respect  to  age  and  educational  level,  The  age  range 
was  from  17  to  SO  yours  with  the  great  Bajcrtty  being  17  to  19«  Formal  education 
rsmged  from  6 to  13  years,  with  a marked  mode  at  12  years.  Most  of  the  subjects 
were  non^sted  sersoBael,  less  than  ^ of  the  group  being  3rd  Clsss  Petty  Officers 
or  higher. 

Use  aes  rare  informed  that  the  teats  were  given  for  research  purnosss.  By 
end  large  notivatioa  was  connldered  to  have  beerj  goud  with  stost  subjects  appearing 
to  enjoy  the  excerienee. 


Ob  the  pages  that  follow,  the  aptitude  teats  psed  in  the  study  are  described, 
la  addltlOB,  sieaB  aeorea,  standard  deviations,  total  nuanber  of  iiais,  tl«e  required 
f»r  the  test  i»d  sooriag  forsmlae  are  iadieated.  It  will  be  noticed  that  wany  of 
the  tests  were  scored  in  several  ways.  The  following  list  gives  a brief  over- 
view of  the  tests  that  were  ^ployed  for  the  study: 


. as..  . *s  _ w j ..  n A. 

Ane  ndvj  oasi*;  unvvvc/ 


(Score,  fros  these  tests  were  alresdy  avail- 
able for  all  candidates) 


GCT 

Mechanical 

nairiSKSticsl  Ressenisg 
Clerical 

2.  Thurstone^s  Primary  Mental  Abilities 

Verbal 
Beasoning 
Soaee 
Nusdser 
Word  Fluency 

3,  Buch  “•  Mil  son  Selection  Systen  (Form  S3) 


Manual  Dexterity 
Visual  Attention 

diiaple 

Cye^and  Coordination 

4,  Euch’s  Survey  of  Working  S?»eed  and  Accuracy 


Coding 

Finger  Dexterity 
Accounting 

S«  Cnilford  - ZUsaersiau  Aptitude  Series 

Part  ly.  Perceptual  Speed 
Part  Vix,  Hechanicai  Knewiedge 


6*.  unpubiishew  tests  frcoi  vs&icus  sources 

Spatial  Orientation 
ViiiMi*!  Memory 
Direction  Marking 
Social  Science 
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SOCIAL  SCIENCES 


This  is  a test  of  your  knowledge  of  such  things  as  history,  government, 
geography,  art,  literature,  etc. 

la  this  test,  there  are  five  possible  answers  to  each  item.  Only  one  of 
these  is  correct.  Decide  which  is  the  right  answer  and  put  its  number  in 
the  parenthesis  in  front  of  the  question. 


1.  ( ) Which  one  was  a French  politician? 

a.  Disraeli 

b.  Talleyrand 

w*  « A VS***MSS 

d.  Henry  VIII 

e.  Lloyd  George 


2.  ( ) Paraguay  is  in 

a.  Asia 

b.  Africa 

c.  Northern  Europe 

d.  The  Balkan  States 

e.  South  America 


Scoring;  1.  Number  of  items  incorrect.  Results;  hiean;  15  S.D.  6.75 

2.  Number  of  items  correct.  Results;  Mean  38  S.D.  11.5 

3.  Number  of  items  correct  minus  one -fourth  the  number  of  items 
incorrect.  Results:  Mean  35  S.D.  12.5 

TIME;  30  Min.  NO.  ITEMS;  72 


MEMORY  FOR  DIAGRAMS 


This  is  a test  of  vour  abilitv  rn  T«»-rn »Tv,K»-r 

Your  task  is  to  look  at  a group  of  ten  diagrams  for  ONE  MINUTE  and 

then  identify  those  ten  from  a group  of  twenty  diagrams  on  another  page. 

*• 

^ „ ...  ..............  jr. 

(Here  are  shown  three  diagrams,  each  of  which  is  from  a different  group 
of  ten  related  diagrams.) 


Scoring:  The  number  of  items  right  minus  the  number  o£  items  wrong. 
Results:  Mean  16  S.D.  5 

TIME:  1 Min.  to  memorisse,  3 Min.  te  answer  for  each  par*.  NO.  ITEc/u5:  30 


CODE  TRANSLATION 


When  the  es.^aminer  says  GO,  you  are  to  translate  a passage  which  is 
given  in  code.  The  code  is  made  up  by  assigning  numbers  to  the  letters 
of  the  alphabet.  To  translate  you  look  up  each  number  in  the  key  to  see 
what  letter  it  stands  for.  You  then  write  that  letter  in  the  proper  space 
below  the  number. 

THE  KEY 


1 

2 

3 

4 

5 

6 

7 

8 

9 

10 

U 

12 

13 

L 

1 

A 

D 

F 

Q 

T 

W 

X 

N 

z 

B 

E 

14 

15 

16 

17 

18 

19 

20 

21 

'>'5 

*%  •% 

A 

25 

26 

G 

J 

M 

O 

R 

U 

Y 

C 

H 

K 

P 

V 

S 

Work  as  rapidly  as  you  can  without  making  mistakes.  Your  score 
is  the  number  of  lines  translated  without  error  in  five  minutes. 

The  first  line  in  the  message  is  already  translated  to  show  how  it 
is  done.  An  * indicates  the  end  of  a word  or  sentence. 

(T)  7 22  n 5 24  T9  18  24  17  2?  13  * 17  7 Ts  IS 

THE  PURPOSE  OF  TE 

II)  ? 2S  + H 19  21  22  *3  ? H n^TT  10  *13  * 


Scoring:  Number  of  correct  letter  translations;  Results:  Mean  102  S.D.  26.5 
TIME:  5 Min.  NO,  ITEMS;  293 

PERCEPTUAL  SPEED,  Form  a 

This  is  a test  of  how  rapidly  and  accurately  you  can  see  objects  in 
order  to  match  them. 

Look  at  the  first  radio  at  the  left.  Which  one  of  the  five  at  the 
right  is  most  nearly  like  it?  Radio  B is  the  one,  so  answer  space  B 
has  been  blackened. 

Look  at  the  second  radio  at  the  left.  Which  radio  at  the  right 
is  most  nearly  like  it?  Radio  C is  the  correct  answer,  so  answer  space  C 
is  blackened. 

Now  find  the  radios  mast  nearly  matching  the  third  and  fourth  ones 
at  the  left  and  blacken  the  correct  answer  spaces. 


-dto 


PERCEPTUAL  SPEED  (CONTINUED) 


Scoring:  1.  Number  of  items  answered  correctly  minus  the  number  of  items 
answered  incorrectly.  Results:  Mean  42.  5 S.D.  8 

2.  Number  of  items  answered  incorrectly.  Median  1.  25  Qi  = . 5 
Q3  » 2.  62 

3.  Number  of  items  attempted.  Results:  Mean  45  S.D.  9 

MECHANICAL  KNOWLEDGE 

In  this  test  there  are  five  possible  answers  to  each  itenr;,  one  of  which. is 
wnicu  la  me  r^gni  answer  to  each  item  and  blacken  clearly 
the  answer  space  connected  with  it. 

Pick  the  tool  that  is  best  for  the  Pick  the  anmvo^-r  that 

most  likely  cause  of  the  trouble: 

The  distributor  points,  lights,  coil, 
etc. , burn  out  every  few  weeka. 

A.  Overcharged  battery 
3.  Undercharged  battery 

C.  Direct  short  in  the  system 

D.  Loose  battery  cables 

E.  Oversined  ignition  wires 


Scoring:  Niimber  of  correct  items. 
Results:  Mean  22  S.D.  8.5 
TIME:  15  Min.  NO.  ITEMS;  First  47 


described  use: 


Cut  threads 


VERBAL-MEANING 


The  first  word  in  the  following  line  is  BIG. 

Big  a.  Ill  B.  Large  C.  Down  d.  Sour 

One  of  the  other  words  means  the  seime  as  BIG.  This  word  is  Large. 
Large  is  answer  B.  An  X has  been  marked  in  B on  the  Answer  Pad. 

Scoring:  Number  of  items  correct.  Mean  29  S.D.  4.  5 
TIME:  6 Min.  NO.  ITEMS:  50 

SPATIAL  ORIENTATION,  Form  b 


This  is  a test  of  your  ability  to  find  your  position  on  a circle  by  looking 
at  the  relative  position  of  objects  inside  the  circle. 

Look  at  the  pictures  below.  At  the  left  side  of  the  page  inside  the 
circle,  is  a TOP  VIEW  picture  of  onr  balls  in  a line.  This  picture  was 
taken  from  a point  directly  above  the  balls.  That  is,  you  are  looking 
straight  down  on  the  formation. 

To  the  right  of  this  picture  are  three  other  pictures  of  the  same  forma- 
tion of  four  balls.  THE  BALLS  HAVE  NOT  BEEN  MOVED.  The  pictures 
are  taken  from  a position  off  to  the  side  of  the  formation  of  balls.  In  all  of 
them  you  are  looking  down  at  an  angle  o£  about  forty-five  degrees. 

Your  task  is  to  decide  where  you  would  be  standing  ON  THE  CIRCLE  to 
get  these  pictures. 

For  example,  in  the  fi'!*«t  pict'ure  the  broad  stripe  is  running  straight 
away  from  you  and  the  bails  are  in  a straight  line.  You  must  -*• 

” _ ’’Z.”.  Thw  otuyte  smaii  white  ball  is  toward  you  and  the  two 

small  white  balls  are  on  the  other  side  of  the  big  ball  from  you.  Hence  you 
must  be  standing  at  "E”.  You  will  see  sn  cn  the.  at  'E”. 

me  letter  "E”  in  the  box  \mder  the  first  picture.  NOTE;  The  shadows 
in  the  pictures  are  not  to  be  used  as  cues  because  they  move  from  one  pic- 
ture to  the  next.  A 


SPACE 


Look  at  the  row  of  figures  below.  The  first  figure  is  like  the  letter  F. 
All  the  other  rigures  are  like  the  first  one,  out  they  have  been  turned  in 
different  directions. 


j ^ 

Now  look  at  the  next  row  of  figures.  The  first  figure  is  like  the  letter 
F.  But  none  of  the  other  figures  look  like  an  F,  even  if  they  were  turned 
right  side  up.  They  are  all  made  backward. 


Some  of  the  figures  in  the  next  row  are  like  the  first  figure.  Some  are 
made  backward. 

In  the  row  of  figures  below,  mark  an  X in  the  box  of  EVERY  figure 
which  is  LIKE  the  first  figure.  Do  NOT  mark  the  figures  which  are  made 
backward. 

Scoring: 

1.  Number  of  items  correct..  Mean  29  S.D.  8.5 

2.  Number  of  items  incorrect.  Median  1.2  Qj  = . 50  Q3  = 3.0 

3.  Number  of  items  correct  minus  the  number  of  items  incorrect 

^ ■* 

TIME:  5 Min.  NO.  ITEMS;  54 


REASONING 


Study  the  series  of  letters  below.  What  letter  should  come  NEXT  ? 

abababab 


The  series  goes  like  thisl  sb  ab  ab  ab.  The  NEXT  letter  in  the  series 
should  be  a.  An  X ka*  been  marked  in  ?a ! on  the  Answer  Pad 

Ndw  study  the  series  of  letters  below.  Decide  what  the  NEXT  letter  should 
ho.  Mark  an  X in  the  box  of  the  NEXT  letter  in  this  series. 

cadaeafa 


This  serlttB  gees  like  this:  cu  da  ea  fa.  You  should  have  marked  g. 


Iv  Kumber  of  items  carrect.  Mean  16. 5 S.D.  5.5 


-5  NO.  33  ^ 

' ■ -.-.  A • ••  ’ 


NUMBER 


At  the  right  are  two  columns  of  numbers  which  have 
been  added.  Add  the  numbers  for  yourself  to  see  if  the 
answers  are  correct. 


A B 
• 16  "42 

38  61 

4S  83 


The  A answer  ie  R.ight,  so  an  X has  been  marked  in  IrI  on  the  Answer 

Pad. 

The  B answer  is  Wrong,  so  an  X 3 been  marked  in  Iwl  on  the  Answer 

Pad. 


Now  check  the  sums  of  me  problems  below.  If  the  answer  is  Right,  put 
an  X infSl  If  the  answer  is  Wrong,  put  an  X ii^w].  If  you  wish  to  change 
an  answer,  draw  a circle  around  this  box  like(j®p  Then  mark  the  new  ans- 
wer in  the  usual  way. 

ABC 
17  35  63 


84  28  17 

29  61  89 

140  124  T^9 


Scoring:  1.  Number  of  items  correct.  Mean  26  S.D.  8 

2.  Number  of  items  incorrect.  Median  1.5  Qi  = . 50  Qa  f 2.80 

3.  Number  of  items  correct  minus  the  number  of  items  incorrect. 
Mean  24  S.D.  9 

TIME:  5 Min.  NO.  ITEMS:  70 


WORD-FLUENC  1’ 


Look  at  the  words  in  the  list  below.  Each  word  begins  withw. 

itVL 



You  are  to  write  several  words  which  BEGQ4  with^.  One  word  you 
might  write  is  Turn  to  the  next  page,  and  in  ^e  spaces  at  the 

TOP  of  the  page  on  the  Answer  Pad.  writs  th-ee  mere  word±  whlcU 
«X<QIN  with^. 

Scoring:  1.  Number  of  correct  words.  Mean  40  S.D.  10 

TIME:  5 Min.  NO.  ITEMS:  SPEEDED 


VISUAL  ATTENTION 


This  ig  a test  of  your  ability  to  kee{>  yeur  eyes  on  one  object  as  vou  sweep 
through  a field  of  many  similar  objects. 

Ypiir  task  is  to  feUew  each  line  from  the  left  side  of  the  page  where  it  be- 
gins across  to  the  right  aide  of  the  page  where  it  ends.  You  will  then  write  the 
nuitlber  of  the  line  by  the  arrow  head  to  show  your  answer. 

For  examplei  in  the  sample  below,  lines  No.  1 and  2 have  already  been 
done  to  show  you  how.  Go  ahead  and  do  3 and  4 for  practice.  Remember  to 
write  the  number  of  the  line  where  that  line  comes  out  on  the  right. 

Do  not  use  your  pencil  to  follow  the  line  if  you  can  help  it.  You  will  work 
faster  if  you  depend  on  your  eyes  alone. 


2. 


Number  of  items  WRONG;  Results: Median  .5  Q3  ' I.IO 
TIME:  5 Min.  NO.  1TEMS:40 


MANUAL  DEXTER.it  Y 


This  is  a test  of  your  ability  to  make  rapid  movements  with  your  hands 
and  fingers. 

Your  task  is  to  make  as  many  "gates”  as  you  can  in  the  time  allowed. 
Accuracy  is  not  important.  However,  you  must  have  four  vertical  strokes 
and  one  diagonal  stroke --that  is --five  strokes  in  all. 

Below  is  a space  for  you  to  practice  to  be  sure  you  know  what  you  are 
to  do.  it  makes  no  difference  which  way  the  diagonal  runs:  left  to  right  or 
right  so  left. 

(A)  w»  mt  tiii  ffu  mt  m m m iw 


Scoring:  o.t  "gates"  completed 

SLetulta:  Means  44  S.D.  7,5 
TIME:  1 Min.  NO.  ITEMS:  SPEEDED 


EYE -HAND  COORDINATION 


Thi#  ii  a test  of  your  ability  to  coordinate  your  eye  and  hand  in  a con- 
tinuing task. 

Your  task  is  to  trace  a line  through  the  opeuings  in  the  vertical  lines 
starting  at  the  arrow  in  the  upper  left  hand  corner.  Draw  a continuous 
line  across  the  page  to  the  right  going  through  the  openings  in  the  vertical 
lines.  When  you  come  to  the  last  alley  on  the  right  then  go  down  that  alley 
to  the  next  opening  and  start  back  to  the  left.  BE  CAREFUL  NOT  TO 
TOUCH  THE  VERTICAL  LINES  AS  YOU  GO  THROUGH  THE  OPENINGS. 


Resxilts:  Mean:  68  S.D.  15.5 


2.  Number  of  errors.  Results:  Mean  22.  5 S.D.  19 
TIME:  2 Min.  NO,  ITEMS:  145 

RECOGNITION  OF  SIMPLE  DETAIL 

Tl.!*  la  a lest  ot  your  ability  to  detect  a simple  expected  detail  in  your 
visual  field. 

Your  task  is  to  put  a check  mark  at  the  end  of  each  line  in  which  all 
letters  arc  "Q's".  If  there  is  an  "O"  in  the  line  any  place,  put  an  "X'*  in 
the  blank  at  the  end  of  the  line. 

The  samples  below  have  been  marked  to  show  you  how.  You  work 
the  unmarked  samples  to  give  yourself  some  practice. 

(A)  QQQQUQQQaQQQOQQQQQQQ 

(B)  Qt2(KlQQQQ«QCKiCn4QQQQQQ  2S_ 

Scoring:!.  Number  of  total  items  attempted;  Results:  Mean  III  S.D.  22 

2.  Number  of  items  RIGHT;  Results:  Mean  105  S.D,  21 

3.  Number  of  itemsWRONG;  Results:  Mean  4.  S.D,  3.75 
TIME;  4 Min.  NO.  ITEMS:  150 


FINGER  DEXTERITY 


When  thf£  «x£miaer  says  GO,  put  a pencil  dot  in  each  of  the  O's  working 
from  left  to  right  or  from  right  to  left.  Work  as  rapidly  and  as  accurately 
as  you  can.  The  time  Hmit  is  five  minutes.  Dots  must  not  touch  O's. 

OOOOOOOOOOOOOOOOOOOO  (1) 
OOOOOOOOOOOOOOOOOOOO  (2) 

Scoring:  1.  Number  of  O dotting  «ttempts  rounded  to  the  nearest  interval 

of  five.  Results:  Mean  450  S.D.  93.75 

2.  Number  of  O dottings  in  which  the  pencil  mark  is  located  out- 
side the  O.  In  this  case  a single  miss  is  sufficient  to  invali- 
date the  entire  line  of  twenty  attempts.  Where  less  than  twenty 
attempts  are  made  in  a line  and  a miss  is  made,  then  the  num- 
ber of  misses  is  rounded  to  the  nearest  multiple  of  five. 
Results:  Median  1.19  Ql  “ .33  Q3  * 3.00 

3.  Number  of  O dottings  in  which  the  pencil  mark  is  located  inside 


the  All  attempts  in  each  line  must  be  correct  for  credit. 
Results:  Mean  310  S.D.  140 

4.  Test  is  divided  into  three  part*.  The  number  of  O dottings  that 
meet  the  criteria  of  3 above  in  part  three  is  subtracted  from 
part  one.  Results:  Mean  20  S.D.  40 
TIME:  1 1/2  Min.  for  each  part  NO.  ITElvIS:  SPEEDED 


COUNTING 


This  task  consists  of  countins  each  nf  tK.  ....... ~i  - *ou  wiu 

......VC  kuai  mere  are  forty  lines  of  text  below.  At  the  end  of  each  line  there 

are  five  blanks  headed  A,  E,  1,  O,  and  U.  For  each  line  you  are  to  count 
and  record  the  number  cf  lc.lkcx-»  m me  line.  Count  ail  five 

vowels  and  record  them  for  each  line  before  going  on  to  the  next  line.  If  a 
particular  vowel  does  not  occur  in  a given  line,  record  an  O in  the  appro- 
priate  blank  at  the  end  of  the  line.  Take  the  lines  in  order,  'ount  one 
vowel  at  a time . 

Line  (l)  is  done  to  show  you  what  is  required.  Work  as  rapidly  and  as 
accurately  as  you  can.  You  will  have  five  minutes  to  do  as  much  of  this 
task  as  you  can. 

(1)  The  statement  that  all  men  are  created  equal 
A's(6)  E's  (8)  I's  (O)  O's  (O)  U's  (l) 

(2)  in  all  things  is  not  true.  This  fact  about  human 
A s ( ) E's  ( ) I's  ( ) O's  { ) U's  ( ) 

Scoring;  1.  Number  of  attempts  made.  Results;  Mean  47  S.D.  8.5 

2.  Number  of  correct  responses.  Results:  Mean  37.  5 S.D.  8.25 

3.  Number  of  incorrect  responses.  Results:  Mean  9 S.D.  4.5 
TIME;  5 Min.  NO,  ITEMS:  2Q0 


DIRECTION  MARKING 


^ This  is  a test  of  your  ability  to  think  rapidly  and  accurately  about 
di^ddtions.  Look  at  the  samole  items  that  follow: 


Ik  rlear  fight,  far  down 
Z.  Utkr  up,  far  left 

3.  Near  down,  near  left 

4.  Far  rights  near  up 


II 

5, 

Far  dov/n,  near  right 

II 

II 

T 

T 

it  II 

«•  It 

ki  II 

r '• 

1 

II 

If 

6. 

7. 

Near  up,  far  right 
Far  iefi,  far  up 

11 

ii 

jj 

Ii 

II 

II  il 

« 

8. 

Near  left,  near  down 

1! 

!i 

• 

II 

II 

II  1 

I!  ii 

II 

' 

!! 

1! 

ii 

II 

!! 

!! 

1 

III  H 

..  t 

ii  1 

ii 

JL 

1 

II 

jl_ 

JL 

Your  task  is  to  place  a mark  at  the  distance  and  direction  from  the 
dot  in  the  center  of  the  box.  The  meanings  of  the  instructions  are  as 

follows: 

1.  Near  right  means  one  step  to  the  right  from  the  center  dot;  near 
left;  one  step  to  the  left. 

2.  Far  right  means  two  steps  from  the  dot  to  the  right;  far  left,  two 
steps  to  the  left. 

3.  Near  up  means  one  step  'up  from  the  dot;  near  down,  one  step  down. 

4.  Far  up  means  two  steps  up  from  the  dot;  far  down,  two  steps  down. 


Now,  you  work  problems  5 to  8 in  the  sample  item  to  the  right  above 
in  the  same  manner.  Place  your  marks  in  the  appropriate  spaces. 

Scoring:  1.  Number  of  items  incorrectly  marked.  Results:  Median  1. 10 
Ql  » .47  Qi  • 2.25 

4.  Number  of  items  correctly  marked  minus  one-fourth  the  number 
of  items  incorreciiy  marked  for  the  first  37  items.  Results: 
Mean  34.  5 S.D.  4.  75 

3.  Number  of  items  correctly  marked  minus  one-fourth  the  number 
of  Items  Inrorrectlv  marked  for  4S  items.  Results:  Mean  38 

S.D.  9 

TIME;  5 Min.  NO.  ITEMS:  48 


Blg^Crlterloa  of  Sybatrlne  School  Perforaance 

The  criterion  of  SubiariHe  School  perforaence  was  final  standing  in  cisss« 
(Snbnarine  School  classes  trpically  eensisted  of  h«tM«en  100  and  200  »en  at  the 
tiae  of  this  study,)  Final  standing  «ss  dsteralnsd  frcs:  a nan*8  final  average 
uhieh  in  turn  was  a coaposite  score  developed  fron  three  sources! 

1,  Aptitude  for  submarinest  This  liras  a rating  made  by  each  trainee^ 
section  instructor  nertainlng  to  the  likelihood  of  his  becoming  a 
successful  submariner.  Only  3 numerical  score  values  were  used: 

2,7S|  3,23  and  3,73,  (It  will  be  remembered  that  a mark  of  4,0  is 
regarded  as  reflecting  the  best  possible  nerforaanee  according  to 
Navy  standards,) 

2,  Ooegating  ayeya^e:  This  is  a composite  of  ratings  made  by  several 

Instructors  who  teach  the  student.  It  is  an  assessment  of  the 
trainee* s performance  in  various  training  devices  such  as  that 
w»Illuv  ‘■“c  ufjc&utiun  ui  uow  uno  stern  planes,  me  numerical 
scores  assigned  to  each  trainee  were  limited  to  the  same  values  used 
in  rating  "Antitude  for  Suhnarines", 

3,  Examination  average;  This  is  an  unweighted  arithmetic  averege  o?  5 

written  examinations  given  to  each  trainee  during  the  8*^eek  course, 
A typical  examination  of  this  kind  contained  approximately  120 
questions.  About  S0)i  of  the  questions  were  of  the  multiple  choice 
variety,  four  alternative  answers  being  The  ressining 

questions  required  the  subject  to  identify  from  sketches  various 
components  of  subaarine  operating  gear.  Several  alternatives  were 

given  and  the  trainee  was  asked  to  match  the  correct  enswar  with  the 

- 


Th#  Sneslal  Cmue>  E^nfp«ted  froti  School  PisrlnQ  Eaitc  Tgainicg 

In  order  to  eteertaln  the  full  effeetiveeeis  of  the  aptitude  tests  for 
predietiBQ  perfonitnee  at  the  Seboerine  School  i it  «nts  thcught  thst  the  perfcrssnse 
of  certsis  treieoes  Rhs  trere  eliasiaated  during  the  course  of  basic  training  should 
be  taken  into  account*  Nine  different  criteria  have  been  stipulated  for  the 
ellMlnation  of  a candidate  from  submarine  training*  These  are: 


1«  Lack  of  ability  to  do  afiademle  work  of  specialty* 

2*  Lack  of  ability  to  do  practical  work  of  specialty* 

3,  Lack  of  application* 

4. >  Onwlilingness  to  do  work  assigned* 

5*  Temperamentally  unfit  for  submarine  duty* 

6*  Tempermnentally  unfit  due  to  lack  of  desire  for  submarines* 
7*  Physically  unfit  for  submarine  duty, 

0.  Disciplinary  problem, 

9,  Psychologically  not  adapted  for  submarine  training. 


It  was  desidad  t.hit  with  two  exceptions; 


nhvciAttllv  rl4  »«eaatt  I I ^ 4 A/l  Mimad 

VZSVSv  nr  • ^ * A*  A «BSaW 


those  disqualified  for  disciplinary  reasons*  elimlnees  should  be  included  in  the 
prediction  study.  (It  appeared  unreasonable  to  predict  physical  fitness  by  means 
of  (Attitude  tests  and  the  number  disqualified  for  disciplinary  reasons  was  too 
£aali  to  be  predicted  reliably,) 

Since  final  standing  in  Submarine  School  would  not  be  available  for  the  die- 


«*..,•  1 a ••  j « 


it  wai  scfuaed  for  these  subjects  that  their  eiiminction  from 


treinln^i  should  ba  regarded  as  placing  them  in  the  lower  half  of  their  class. 
Because  tetraehoric  ^rrelations  were  used  in  the  analyses  described  later,  it  was 
«■  V V A V ssmS  s rsra  ref  istd  guess  Si  to  lahere  these  disqualified  persons 

l ogically  should  have  been  piiiCini*  The  nim^er  of  elimisees  included  in  the  sesple 
of  trainees  stsdied  acceanted  fur  8.4K  of  the  tctcl  simber  of  eases* 


IfiL 

In  (Dtdesr  to  deteniine  vdiether  the  reliability  of  the  criterion  would  be  a 
lerioutly  liaiting  factor  on  correlationa  with  aptitude  test  sccrss,  gradei 
obtained  by  iraineei  during  the  fourth  week  ef  school  wore  correlated  with  those 
obtained  during  the  eighth  week* 

For  this  purpose  a sample  of  100  men  was  obtained  by  taking  every  fourth  man 
from  six  different  classes*  Pearson  product -moRent  correlations  were  then  computed 
between  the  fourth  sod  eighth  weeks*  scores  and  the  results  corrected  by  the 
Speatman-Brown  formula.  The  results  obtained  appear  in  Table  1.  A second  sample 
drawn  from  five  later  classes  yielded  highly  similar  results. 

TABLE  I 

‘ffiE  RELIABILITY  OF  SUBMARINE  SCHOOL  CRITERIA 
BASED  ON  A SAMPLE  OF  100  MEN  SELECTED  FROM 
aASSES  >10  TO  4S 

(Fourth  week  vs.  Eighth  week  scores) 


a 

r (Qorrected) 

Aptitude  for  submarines 

100 

.73 

• t*W  V 

100 

.48 

Evemination  average 

100 

. K’i 

e 

An  estimate  of  the  reliability  of  the  composite  criterloiti  on  which  final 
steading  wej  betedi  was  ,90.  It  was  concluded  that  the  Submarine  School  criterion 
was  sufficiently  reliable  so  as  to  not  seriously  limit  any  relationships  with 
predictors. 

Three  measures  of  performance  aboard  ship  were  deve'loped  for  this  study, 

Their  developmeut  was  oriented  toward  measurement  of  two  broad  aspects  of  per> 
formaaoet  Cl>  that  idsleh  oould  be  regarded  as  prlasrily  technicai  in  nature;  and 
(3)  that  which  could  be  regarded  as  mainly  adjustive  or  attitudinal  toward  ship** 
board  and  Navy  life,  The  three  devices  for  assessing  shipboard  performance  end 


their  osessurenent  char set eristics  are  described  in  detail  in  Parts  I,  II  and  III 
of  this  series  of  reports.  They  will  be  taentioned  only  briefly  here* 

1.  Perforwance  rating  scale.  A graphic  aaa=«to-raBa  performance  rating 
scale  consisting  of  10  traits  was  completed  by  three  of  each  men’s 
superior  officers  as  a part  of  the  shipboard  criterion.  The  raters 
usually  were  the  two  leading  Oiief  Petty  Officers  of  the  gang  and 
the  dis-lfio!!  officer  of  the  man  concerned.  Some  of  the  traits 
referred  to  a man’s  technical  performance  aboard  ship  and  some  were 
more  concerned  with  attitudinal  and  adjustive  behavior.  The  pef 
formance  referred  to  in  the  rating  scale  was  described  in  behavioral 
terms  which  were  as  concrete  as  possible  but  necessarily  quite 
general.  The  rate-rerate  reliability  and  inter-rater  egreesent  on 
this  scale  proved  to  be  highly  satisfactory,  the  former  being  above 
*60  for  periods  of  from  five  to  nine  months  and  the  latter  ranging 
from  .45  to  ,65  for  single  traits  and  better  than  -7r> 

score,  (See  Part  II,  this  series  of  reports,^) 

2.  Perforwawo*  I**o  periormance  check  lists  were  developed 

I 

for  this  study,  one  for  Electrician’s  Mates  and  one  for  Enginemen. 
These  also  were  rating  devices  to  be  filled  out  by  each  man’s  leading 
petty  officer  and  division  officer  but,  unlike  the  rating  scale,  they 
contained  very  specific  statements  about  technical  Job  performance, 
Tbey  were  designed  tc  reflect  ss  many  specific  bits  of  regular 
isportani  technical  shipboard  bi^avior,  characteristic  of  the  two 
rates,  at  possible.  The  iRteT*^ater  agreement  on  total  scores  on 

^ WllscB,  CiL.,  Backie,  S.R.  and  Bac&aer,  D.N,,  RSSEAHCH  OK  IKE  uEVELOFMENT  OF  SHIP- 

PART  II  ’’The  Ose  of  A Performance  Rating  Scale  In 
The  Ke«8ur«Hi9Bt  of  Performance  of  Enlisted  Kata!  Personnel"  (KR-153«625}  Manage** 
sisfit  and  Marketing  Reaearch  Corporation*  February  1954. 
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these  check  lists  wee  very  high,  above  *00.  (See  Part  III,  this 
series  of  reports,^) 

3,  Job  sawole  perfonwawce  tests.  Hie  third  shipboard  criterion  measure 
was  coiq>rised  of  batteries  of  Job  sample  tests  designed  around  the 
Electric! on* s Mstei  snd  Engineraen  jobs,  A sample  of  shipboard  tasks 
which  was  as  representative  of  the  Job  as  possible,  under  the  limits 
of  testing  time  and  operational  conditions.  w»«  develeped  Into  s 
battery  which  could  be  adroiristered  under  standard  conditions  and 
objectively  scored.  Also  included  in  the  battery  of  performance 
tests  was  a written  Job  knowledge  test  of  the  conventional  multiple 
response,  objective  type,  and  a test  of  knowledge  of  safety  pre-* 
cautions.  Results  of  the  administration  of  these  tests  showed  that 
individual  tests  had  moderate  to  high  reliability  (.50  to  .80)  and 
that  the  composite  battery  for  both  Electrician’s  Hates  and  Englnemen 
had  high  reliabilities  (.90),  (See  Part  I,  this  series  of  reports,") 


2 Kilsoa,  C.L.,  liackie,  S.R.,  and  Buckner,  D.N.,  RESEARCH  ON  THE  DEVELOPMENT  OF 
®iIPB0.*RD  P£?.F0Rwni^£  nEASUnES.  PART  ill  The  Use  of  Performance  Check  Lists  In 
Heasurenent  of  Shipboard  Performance  of  Enlisted  Naval  Personnel"  (NR**!S3*^25) 
ManagemeAt  and  Marketing  Research  Corporation,  February  1954. 

^ Wilson.  C.L.  and  Hackle,  R.R,,  RESEA.RCH  ON  THE  DEVELOPMENT  OF  SHIPBOARD  PSl- 
PORMANCE  MEASURES.  PART  I *^rhe  Use  of  Practical  Performance  Tests  In  The 
Measurement  of  Shipboard  Performance  of  Enlisted  Naval  Personnel (NR-153-625) 
Managenent  snd  **arketing  Research  Corporation,  February  1954, 
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Chapter  IV 


V/4LIDTTY  OF  .APTITUDE  TESTS  FOP.  TSE  SOSMASIKE  SCJAXiL  CRITERIOfi 

Preilalnary  to  the  enalysii  of  the  relationships  discussed  in  this  and  subse- 
quent  chapters,  raw  scores  on  all  tests  and  criterion  measures  were  converted  into 
standard  form.  In  order  to  facilitate  correlational  procedures,  all  standard  scores 
in  turn  were  converted!  into  positive  whole  numbers,  ranging  from  0 to  9 (the  STEN 
scale) , STEN  scores  of  0 throisgh  4 iscltideu  Ihs  lower  hslf  o*  the  scores  lor  soy 
particular  variable,  witile  STEMS  of  5 and  higher  included  the  upper  half. 

For  the  purposes  of  this  study,  it  was  considered  desirable  to  be  able  to 
combine  students  from  several  Submarine  School  classes  on  whom  predictor  scores 
were  available.  The  over-all  plan  was  to  determine  the  validities  of  the  several 
aptitude  tests  on  oneHhalf  of  the  total  available  sample  and  cross-valldate  these 
results  on  the  other  half.  In  order  that  these  samples  be  of  appreciable  sixe.  it 
was  necessary  to  combine  men  from  different  submarine  classes  into  larger  groups. 
This  pro  slSv  was  thought  to  remove  any  bias  in  the  results  that  might  be 

associated  with  particular  classes  or  with  recruits  at  particular  times  of  the  year. 


Before  such  a emshln^Hn  Initictci,  hcT* 


'^*1  tatatw 


datefaine  whether  or  net  there  were  systematic  differences  between  Submarine  School 
classes  with  respect  to  the  general  levels  of  aptitude  involveH- 

An  initial  hurdle  in  the  screening  of  Submarine  School  candidates  was  that 
they  must  have  had  a combined  score  of  105  on  the  two  Navy  basic  battery  tests,  GCT 
and  ARl,  In  order  to  determine  whether  seaqjles  from  the  several  classes  wore 
sisilsr  witn  evipaOi  ic  scores  on  these  two  tests,  means  of  the  unweighted  sum  of 
GCT  and  ARl  scores  were  computed  for  each  of  the  nine  classes  used.  The  signifi- 
cance of  the  differences  between  cU  possible  combinations  of  these  mean  scores 
was  tested  by  means  of  the  t-test.  Using  the  5%  level  of  confidence  as  the  criter- 
ion for  rejecting  the  null  fcyppt&ssls,  the  t-tests  showed  in  all  cases  that  there 
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were  no  significant  differences  between  the  several  classes  in  the  abilities 
seasared  hj  the  tests«  In  Table  II,  the  means,  standard  deviations  and  standard 
errors  mmj  be  inspected  and  in  Teble  III,  a Gsatviy  of  the  t’^values  between  classes 
can  be  seen, 

TABLE  II 

WEANS,  STANDARD  DEVIATIONS  AND  STANDARD  ERRORS  OF  T1I£  s ifEAN 
OF  COMBINED  G.C,T,  AND  A.R.I,  SCORES  FOR  SEVERAL  SUBMARINE  SCHOOL  CLASSES 


N 

Standard 

Deviation 

Standarcii  Srror 
of  the  Mean 

40 

93 

115.01 

12,72 

1,33 

jn 

~«A 

121 

113.77 

11.97 

1.09 

42 

95 

114.74 

10.35 

1.07 

43 

60 

116.06 

11.30 

1,27 

44 

73 

115.97 

11,05 

1,30 

4S 

113 

114,33 

11,00 

1.04 

46 

103 

114,33 

10.84 

1,07 

1 41  4 

X X o. 7X 

m.lAi 

0.B8 

w 

12B 

114,35 

10.28 

0.91 

Total  950 


114.70 


11,05 


TABLE  ill 


iHRjffiOS  FOR  ALL  UEAN  DIFFEREWCES  OF  GOMRINEl}  GENERA  CLASSIFICATION  A«!> 
AEITiilusiICAL  REASONING  TEST  SCORES  FOR  SEVERAL  SUBMARINE  SCHOOL  CLASSES 


Class 

40 

41 

HA 

43 

44 

45 

46  47  48 

40 

— 

41 

.721 

42 

.156 

- .635 

43 

-.571 

-1.368 

44 

.516 

-1.2% 

-.7^> 

.030 

45 

. iOV 

- .703 

-.060 

.750 

.685 

46 

.398 

- .367 

.271 

1.042 

.974 

.336 

47 

.690 

- .100 

.599 

1.392 

1.312 

.675 

-.303 

4C 

.099 

- .761 

-.078 

.775 

.706 

-.  014 

- 

.370  -.742 

With 

these  results. 

men  from 

all  classes  were 

then  comb 

ined  to  form  a total 

soapie  os  cases  on  whota  test  scores  were  available  as  predictors.  The  men  were 
then  aitigned  alternately  to  the  vaHAfttiA*  anti 
total  of  sbout  475  sen  in  twh  5ub*-sanipi«« 


AiLEerller, Study  of  the  Validity  of  Teats  fQr_$ubn)arlneLJshQpl_CaadidatM 

A report  by  Bartlett,  published  in  1945,  describes  an  earlier  validation  of 
proeedurei  for  the  selection  of  Submarine  School  candidates.^  Bartlett  presented 
findings  cf  Taliuities  for  the  several  Navy  basic  battery  tests  using  Navy  grades 
baaed  on  operations  snd  written  examinations,  as  the  criterion.  The  description 
of  the  criterion  in  his  study  sugg€»«s  ^^Bt  it  was  similar  to,  but  not  identical 

^ Bartlett,  N.R.,  **Correlationa  of  Tests  With  Grades  In  Submarine  School",  Bureau 
of  liedieine  aad  Surgery  Research  Project  Nc.  X>243,  Medical  Research  Department, 
0,S.  Sabnarine  Base,  New  Londoa.  CoAneeticut,  February  1945. 


with,  the  oriti  used  in  this  study.  With  a saaple  of  one  class  totaling  210  subjects^ 
the  product “liooent  correlation  coefflcieats  for  various  aptitude  tests  vrere  as 
follows: 


General  Classification  Test 

,25 

Ailthmetical  Reasoning  Test 

llechanicel  Knowledge 
(Electrical) 

.26 

Mechanical  Knowledge 
Cieohanicai) 

a M 

Reading 

.20 

Mechanical  Aptitude  Test 

GCT  4 ARl 

.31 

GCT  ■¥  Mechanical  Knowledge 
(Electrical) 

.35 

hlrow  these  findings,  Bartlett  concluded  that: 

**A  combination  of  scores  for  the  General  Classification  Test, 
Arithmetic  Reasoning  Test  and  Mechanical  Knoifiedge  Tests  is  a better 
index  of  grades  in  Submarine  School  Cv,.,^iai  v^iasslflcation 

Test  sertro 

The  ceel'fictents  reported  by  Bartlett  am  nil  ••••dcrcctlmoic*  oi  tne  pre- 
usctive  validity  of  the  tests  since  they  are  uncorrected  for  restriction  in  range. 
It  might  be  added  that  they  would  also  be  underestimates  if  only  the  passing 
candidates  were  considered  in  the  study.  It  is  not  known  vdiether  this  was  the  case 
in  Bartlett'S  study, 

ValiditY  of  Sinai o Teiti.tn_the_Pr^jifflt_Siad¥ 

In  Tsble  IV,  the  tests  in  this  study  which  proved  to  hav*  validities  signlfi> 
cantiy  greater  than  zero  for  predicting  Submarine  School  standing  are  listed.  It 
will  be  remembered  that  candidates  who  were  eliminated  from  training  for  one  reason 
or  snether  were  assigned  to  the  lower  half  cf  their  Submarine  School  class  in 


c<»pvting  those  coefficients 


TABLE  IV 

VALIDITY  OF  SEVERAL  TESTS  FOB  THE  SUBMARINE  SCHOOL  CRITERION 
(Tetrachoric  Coefficients) 

N = 475* 

Direction  Marking 

.46 

Navy  Mechanical 

.43 

Navy  GCT 

.39 

Navy  AnI 

.34 

Guilfcrd^ZiRH-erffian  mechanical  Knowledge 

.32 

Thurstonc  Space 

.26 

Social  ScienRAx 

Thurstonc  Reasoning 

,23 

Spatial  Orientation 

.18 

Finney  Dexterity 

,17 

Thurstone  Number 

.15 

* Except  as  noted  in  the  text. 


In  the  Appendix,  the  entire  matrix  cf  correlations  between  Submarine  School 
criteria  and  aptitude  test  scores,  including  those  for  more  than  one  kind  of  score 
for  many  of  the  tests,  can  be  inspected.  For  the  most  part,  these  coefficients  are 
based  on  475  ««*#*«.  ,-Kiire  siuoy.  for  two  of 

the  vsrisbles,  the  Direoilon  Marking  test  and  the  Social  Science  test,  N was  319 
since  these  tests  were  not  developed  when  testing  first  began  in  New  London. 

Validities  of  the  Aptitude  Test  Scores  in  Comblpation 

Using  the  Gengerelli  approximation,  multiple  correlation  eoefficients  next 
were  computed  between  various  combinations  of  test  scores  and  the  school  criterion. 
In  Table  V,  the  values  obtained  by  this  procedure  may  be  inspected. 
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TABLE  V 


VALIDITIES-  BETA  iyEIGIiTS,  AND  TnE  MULTIPLE 
CORRELATION  COEFFICIENTS 
FOR  SEVERAL  TESTS  AND  TKEIK  COii£iNATIONS 


Test 

Nuiber 

Test 

Validity 

Coeffi- 

cient 

Beta 

Weight 

Test 

Batterv 

50 

Direction  Marking 

.46 

.46 

50 

.46 

12 

Mechanical  Aptitude 

.43 

.34 

50*12 

.58 

62 

Ceneral  Class,  * 
Arith.  Reas. 

,40 

.10 

50*12+62 

.59 

11 

General  Classifi- 
cation 

.39 

.11 

50*12+11 

.59 

13 

Arithmetical 

Reasoning 

,34 

.19 

50*12*13 

.61 

The  Direction  Marking  lest,  which  showed  the  highest  validity  for  the  Submarine 
School  criterion,  was  the  first  choice  by  the  Gengerelli  technique.  >Vhen  the 
Guilford  Zimmerman  laechanical  Aptitude  test  was  added  to  the  battery,  the  multinle 
R becam»*  luoiviiun  OX  uuT  * ARl  had  the  next  highest  validity  and,  when 

added,  increased  the  multiple  to  only  .59.  CCT  tor  oi/i  + ARI  also 

yielded  a multiple  R of  .59.  Finally,  it  was  found  that  the  addition  of  ARl  to  the 
first  two  tests  increased  the  multiple  to'  .61.  This  appeared  to  be  the  most 
predictive,  yet  ecorsomical,  combination  of  aptitude  tests  for  the  Submarine  School 
criterion  in  this  study, 

CgBtt«-ValldattQB 

Es?£w%  obtained  a multiple  R as  large  as  this,  especially  when  compared  to 
that  which  would  have  obtained  through  the  regular  selection  battery  (GCT^ARI)  for 
the  saw^  subjects  (.410),  the  question  of  cros8*^8lidation  then  immediately  aroitc, 
SiQce  only  3x6  subjects  hsd  taken  all  three  of  the  selected  tests,  the  cross- 
villdation  study  was  limited  to  that  ninsber. 
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Dsisg  the  appropriate  beta  weighti,  a criterion  score  was  predicted  for  each 
aan  in  the  eross**validatiou  stssplc  fras  his  scores  on  the  Direction  Marking^ 
Gttilford'^inaiemian  Mechanical  Knowledgoi  and  Nayjr  tests.  These  predicted  scorei 
then  were  correlated  with  actual  class  standing.  The  coefficient  of  correlation 
obtained  was  R = .5St  indicating  that  shrinkage  had  not  been  severe  and  that  this 
hatter;  of  tests  represented  a substantial  improvement  over  the  screening  battery 
then  in  use, 

CflirectloiL-for  Restriction  in  Range 

In  order  to  apnreeiate  the  full  selective  power  of  aptitude  tests  as  ore- 
uietori  of  Submarine  School  performance;  it  was  necessary  to  determine  the  validity 
of  the  test  battery  without  the  restriction  in  range  introduced  by  selection  of 
candidates  on  the  basis  of  a combined  ARI  and  GOT  score  of  105,  Correcting  for 
this  restriction  should  roveail  the  results  that  would  have  been  obtained  had  the 
submarine  trainees  been  representative  of  the  entire  recruit  population  with 
respect  to  the  abilities  measured  by  these  two  tests, 

ii<  ^aiiuu  is  a tunction  or  tne  intercorreiations  of 

the  tests  and  thei.  variances.  It  was  first  necessary  to  obtain  a satisfactory 

2 

estimate  of  these  statistics  for  the  two  tests  concerned.  Stuit  has  reported 
Inter^correlations  between  GCT  and  ARI  of  ,69,  .79  and  .72  on  random  samples  of  500, 
933  and  603  cases.  Using  these  values,  an  average  of  ,74  was  obtained  after  using 
Fisher’s  Z. transformat ion. 

Since  the  scor'es  for  both  tests  were  in  standard  form,  with  a population  mean 
of  SO  and  a staadard  deviation  of  IG  by  design,  it  was  nn««ible  tc  use  10  ss  sn 
estimate  of  the  variability  in  an  unrestricted  population.  There  is  considerable 
evldenea  from  Stuit  and  other  sources  that  this  value  holds  up  reasonably  well 

Stuit,  D.B.,  <Ed«)  Pereoamel  Research  aad  Test  Development,  Princeton  University 
Press,  Priacetcn,  New  uersey,  1947, 


eaipirieally.  The  variance  of  the  unwelght&i  eotnpojite  scores  ir.:  the  two  tests  was 

a 

then  f»btalned  by  using  the  formulat 

■*  ^2  * . 

Usleg  this  equation  and  the  estireates  of  population  perataeters  described 
ibovet  the  estinate  of  the  variance  in  the  population  without  restriction  in  range 
was  347*82« 

The  next  task  was  to  estimate  the  variance  for  the  restricted  samplei  that  is, 
the  sample  of  Submarine  School  candidates*  To  do  this,  the  unweighted  scores  from 
the  two  tests,  GOT  and  ARl,  were  added  since  this  is  the  procedure  that  was 
actually  fcllcacd  in  satablishing  the  cut-off  score*  The  varianca  of  combined 
scores  was  then  computed  on  the  restricted  group  of  950  trainees  and  found  to  be 
122*10,  This  indicated  that  rather  severe  restriction  in  range  had  occurred  at  a 
result  of  selection  procedures.  The  ratio  of  the  variance  in  the  unrestricted 
recruit  population  to  that  in  the  Submarine  School  cendidate  population  was  2,85* 

In  order  to  determine  the  multiple  correlation  coefficient  for  the  experi- 

Wattarw  frtv  an  r< ct aH  nrnim.  lit  Mns  necessarv  to  correct  not  only 

the  correlations  of  each  test  with  the  criterion  for  restriction  in  GOT  + ARI  scores, 
but  the  inter>-correletions  of  the  tests  as  well,  Twc  formulae  were  neceasary  to 
accomplish  this  task,^  Formula  (1)  below  was  employed  to  determine  the  corrected 
validity  coefficients  between  each  test  variable  and  the  variable  of  ARl  * GCT  on 
wiiich  the  restrictions  took  place. 

Formula  (2)  was  employed  to  determine  the  corrected  coefficients  between  two 

^Guilford,  J.P*,  Fundamental  Statistics  in  Psychology  and  Education.  McGrawdiiil 
Book  Company,  Inc*,  New  York,  Toronto,  London,  1950,  p*  454, 

^ From  Thorndike,  ^.L*,  Personnel  Selection,  New  York;  John  Wiley  and  Sons,  1949, 
pp*  173-174, 
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teft  variiblei  v4ilch  were  both  subject  to  restriction  by  a third  variable  (ARI  4 
GCT)i  These  were  the  corrected  intercorrelatiojis  of  the  predictor  variables, 

rio  - I.* 

(1)  * *1  (Where  S and  s are  the  standard 

* deviations  in  the  unrestricted 

«/  2 2 and  restricted  populations 

1 * rj2  ♦ tj2  respectively.) 

•1 


(2) 


Rio  = 


S3^ 

*^12  * >^13  ^^23  < T3" 


- 1) 


I A. 


iC- 

S32 


1) 


S3" 


Using  the  corrected  validities  and  test  Intercorrelations  obtained  in  this 
manner,  the  Gengerelli  approximation  again  was  used  to  estimate  the  multiple  R for 
the  unrestricted  population,  When  this  was  done;  R was  found  to  be  ,83,  A 
similar  procedure  using  the  regular  screening  battery  (GCT  + ARI)  yielded  a cor- 
rected R of  ,59,  T-tests  of  the  difference  between  coefficients  resulting  from  use 
of  the  Navy  and  experimental  test  batteries  were  significant  beyond  the  IX  level  of 
confidence  in  favor  of  the  experimental  battery  under  both  restricted  and  un-~ 
restricted  eer.dltlvM».  Tlieao  treauics  are  summariced  in  Table  VI, 


TABLE  VI 

COMPARISON  OF  NAVY  AND  EXPERIMENTAL  TEST  BATTERIES 
FOR  PREDICTING  THE  SUBMARINE  SCHOOL  CRITERION 


Battery 

xest  Multiple 

Number  R*  t 

Signifi- 

cance 

l^ultiple  Signifi- 

R*^  t cance 

N 

Navy 

62  ,40 

.59 

475 

2,74 

c.oi 

6.99  <.01 

Experimental 

50.  12,  13  .55 

.83 

316 

Corrected  lor  restriction  in  range. 
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Chapter  V 


At 


np  THF  EXpraiMENTAL  APTITUDE  TESTS 

iwD  sTmMMtik  SCHOOL  CRITERIA 


. In  an  effort  to  identify  the  basic  conposition  of  the  experinental  test 
battery  and,  if  possible,  learn  soaething  about  the  underlying  nature  of  the 
Submarine  School  criterion,  a centroid  factor  analysis  of  27  variables  including 
Final  Average  and  its  three  components  tras  carried  out. 

For  the  »08t  part  this  analysis  was  quite  successful,  several  well^identified 
factors  clearly  emerging.  In  addition.  SOw€  o*  her  meaningful  factors  were 
tentatively  identified  but  these  should  be  verified  in  other  studies  before  their 
nature  can  be  regarded  as  firmly  established.  It  is  felt  that  some  important 
characteristics  of  the  Submarine  School  criterion  were  uncovered. 


Abbreviated  tables  of  loadings  or.  the  several  factors,  together  with  tentative 


identifications  of  each  factor,  appear  on  the  following  pages. 

The  complete  tables  of  loadings,  before  and  after  orthogonal  rotation,  appear 
Im  tUA  Ann««ifliv. 


FACTOR  1:  MECHANICAL 


Navy  Mechanical  >B3 
Guilford-Zimmennan  Mechanical  Knowledge  ,70 
APT  for  S/M  .65 
Final  Average  ,64 
Operating  Average  .56 
Examination  Average  ,53 
GCT  .43 
Space  **  0 .36 
Thurstone  Space  .34 


Factor  I is  clearly  mechanical  in  nature,  resembling  closely  the  Mechanical 
Exporionee  factor  found  in  many  analyses.  It.  is  believed  to  involve  knowledge  of 
mectianicai  apparatus  and  principles  rather  thsu  innate  ability  to  be  a Mechanic. 

The  Submarine  Sdiool  criteria  are  heavily  loaded  on  this  factor.  This  is 
regarded  as  an  iiw^rtant,  thought  not  unexpected,  finding  of  the  st«dy.  The 
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analytes  are  consistent  in  reflecting  the  importance  of  screening  Submarine  School 
candidates  on  mechnniesl  and  ssstial  tests. 


F/>CIOB  II;  PERCEPTOAL  SPEED 


Guilford**Zinnennan  Perceptual  Speed  »56 
Counting  ,51 
Gate  Making  .SO 
Coding  ,49 
Simple  Detail  ,32 
Line  Following  ,27 


Factor  XI  clearly  appears  to  be  the  well-known  Perceptual  Speed  factor.  It 
is  described  by  French^  as  characterized  by  the  task  of  finding  in  a mass  of  dis- 
tracting material  a given  configuration  which  is  borne  in  mind  during  the  search. 
The  fact  that  the  Gate  Making  test  appears  heavily  loaded  on  this  factor  may 
reflect  a lack  of  other  tests  in  the  battery  calling  for  Finger  Dexterity. 


FACTOR  III;  VERBAL -ACADEMIC 


Social  Science 

.79 

GCT 

.70 

Social  Science  Bluffs 

.69 

uack  01  biuliingl 

Thurstone  Verbal 

.56 

Tfaurstone  Word  Fluency 

.36 

Factor  III  is  similar  to  that  usually  defined  by  social  studies  or  social 
science  tests.  It  no  doubt  is  confounded  with  the  verbal  factor  in  this  analysis, 
necessitating  a complex  designation.  The  word  fluency  test  also  comes  out  on  this 
factor  no  doubt  because  there  were  no  other  variables  in  the  analysis  to  help 
define  the  fluency  factor. 

The  failure  of  the  Submarine  School  Final  Examination  and  Final  Average  to 
come  out  on  this  factor  is  readily  explained  by  the  prior  screening  of  the 

l" 

^18  and  other  definitions  have  been  borrowed  from  French,  3.W. , **The  Description 
of  Aptitude  and  Aehiev^ent  Tests  in  Terms  of  Rotated  Factors”  Psychometric 
HoBograoha.  Number  5,  1951.  p.  278. 
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oandidstes*  verbsl  ability  on  the  batis  of  6C1'  and  ARI  scores. 


F/ICTOR  IV:  CRAPES ■jOIIVAIIW 


Final  Average 

.53 

Examination  Average 

.51 

0-Dotting 

.51 

Direction  Marking 

.40 

Operating  Average 

.39 

Tracing 

.39 

Gate  Making 

.35 

Aptitude  for 

.32 

A number  of  studies  have  produced  n Grades  Factor  on  which  there  were  insuf- 
ficient loadings  from  well  identified  tests  to  determine  anything  about  its  psycho- 
iogioai  nature.  Among  its  possible  interpretations,  motivation,  academic  interest 
and  persistence  have  been  advanced.  Factor  IV  suggests  Itself  as  such  a factor 
because  of  the  high  loadings  of  Final  Average  and  the  presence  of  the  other  test 
variables  vdiich  nay  possibly  reflect  motivation  or  persistence.  Performance  on  all 
of  these  tests  (0*Dottlng,  Direction  Marking,  Tracing  and  Gate  Making)  is  dependent 
la  large  part  on  the  willingness  of  the  subject  to  stick  at  a speeded,  repetitious 
«nu  resaviveiy  nonotoRsus  task. 

While  the  nature  of  this  factor  can  bo  no  more  than  soecwiat-id  nn  VrAw  tvo 
results  of  the  presen^i  study,  it  appears  most  interesting  and  is  important  in  the 
Subaarine  School  criterion. 


FACTOR  Vt  COMPLEX  VISUALIZATION 


Direction  Making 

.77 

Thurstone  Space 

.44 

Tnursione  Reasoning 

.44 

Memory  for  Diagrasi 

Counting 

,37 

Line  Following 

.37 

Thurstone  Number 

.34 

Factor  V !?  difficult  to  iaterprat.  It  is  probably  a composite  of  three  or 
four  factors  sdilch  are  somehow  related  and  all  measured  iln  some  degree  by  the 
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Oiiection  Markina  teat.  Direction  Marking  or  direction  plotting  hss  been  found 
have  high  lusdiagi  on  the  Visualization  factor  in  a number  of  i<tudies.  Koff~  found 
direction  marking  teitn  had  high  loadings  on  a factor  which  he  called  Complex 
Perception.  Attention  and  memory  tests  also  were  loaded  on  this  factor. 

Since  space,  reasoning,  memory  and  number  all  seem  to  be  involved  in  Factor  V, 
it  must  be  concluded  that  the  factor  is  complex.  Because  of  the  visualizing  nature 
of  the  Direction  Harking  and  several  of  the  other  tests,  the  factor  is  tentatively 
labeled  COMPLEX  VISUALIZATICH,  Its  nature  should  be  explored  more  fully  in  a more 
definitive  analysis. 


FACTOR  VI;  NUMBER 


Final  Average 

.63 

Aptitude  for 

.56 

Thur atone  Number 

.53 

Operating  Average 

.51 

Navy  Clerical 

.49 

Coding 

.39 

Examination  Average 

.39 

Navy  ARI 

.32 

All  of  the  aptitude  tests  with  appreciable  loadings  on  this  factor  clearly 


hnvo  mimhw  Tin.  i 
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criteria,  Final  Average  and  Aptitude  for  Submarines  are  Interesting  and  plausible. 
During  the  course  of  training,  a submarine  candidate  is  required  to  learn  a great 
many  things  for  which  number  ability  would  be  important.  Examples  of  these  are 
learning  the  frame  numbers  of  the  submarine,  remembering  the  cubic  footage  of 
certain  tanks,  the  pressures  in  various  lines,  being  appraised  of  operating  speeds 
and  deptfis,  calculating  weights  of  given  volumes  of  sea  water,  fresh  water,  fire, 
oil,  etc.  This  lends  support  to  the  proposed  identity  of  this  factor  and  points  up 


* Roff,  M,F.,  Personnel  Selection  and  Classification  Prscoduros:  Perceptual  Tests, 
A Factor  Analysis,  Project  Report,  Project  No,  21-02-009,  USAF  School  of 
Avistioa  Medicine,  Randolph  Field,  Texas. 
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the  importance  of  Number  varicnee  in  the  Submarine  School  criterion. 


FACTOR  VII ! VIS0AL-R£AS0NIN6 


Navy  ARI  .56 
Space*4>  .48 
Thurstone  Reasoning  .44 
GCT  .36 
Memory  for  Diagrams  ,32 
Navy  Clerical  .32 
Navy  Mechanical  .24 
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visual  components.  The  entire  Navy  basic  battery  is  loaded  on  this  factor,  but 
predominantly  ARI.  together  with  Thurstone**  Reasoning  from  the  Primary  Mental 


Abilities  battexy  and  the  Spatial  Orientation  test  which  is  thought  to  involve  both 
visualization  and  reasoning  to  an  appreciable  extent. 


FACTOR  VIII;  CAREFULNESS?  CONSERVATIVENESS? 


Navy  Clerical 

.78 

SiuSple  Detail 

f\ 

• W 

Social  Science  Bluffs 

.41 

Tracing 

,35 

Line  Following 

.31 

CVI^mal 

Thurstone  Verbal 

.31 

Counting 

.29 

Factor  VIXl  offers  an  interesting  hypothesis  although  nothing  definite  about 
its  nature  can  be  firmly  established  on  the  basis  of  this  study,  ^t  first  glance 
the  factor  appears  to  involve  perceptual  speed.  The  high  loading  of  (lack  of) 
Social  Science  Bluffs,  however,  which  was  a score  based  on  items  which  had  no 
answers  (and  which  therefore,  according  to  directions,  should  have  been  omitted  by 
the  respondent)  demands  special  interpretation. 

The  Carefulness  factor  previously  has  been  defined  largely  by  wrong  scoreo 
where  high  scores  reflect  lack  of  carefulness.  Since  wrong  scores  were  not 
included  In  this  analysis,  the  similarity  between  this  end  other  factors  described 
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as  Carefulness  cannot  be  detemined.  The  substantial  neoatlve  correlations  between 
total  anc  WTCSQ  scores  On  Siich  tests  as  bi^ie  Detaiit  Countiiigi  and  'i’raCingi  piUS 
the  high  negative  relationship  between  total  score  and  bluffing  score  on  the  Social 
Science  test,  lend  support  to  the  notion  that  high  total  scores  on  these  tests  may 
reflect  conservativoness  or  carefulness  of  response  as  well  as  the  other  abilities 
associated  with  then.  Further  work  in  an  effort  to  test  this  hypothesis  would 
seen  worthudiile. 


38  - 


ChSpbCC  VJ' 

PrvEDICTiOH  UF  PERFXKikiANCE  ABOARD  SUBMARINES  AS 
DETERMINED  BY  RATINGS  AND  TESTS 


RgtlBCt  of  General  Train 

One  of  the  initial  hypotheses  of  this  study  was  that  variance  of  an  nttitudi- 
nal  or  adjustment  nature  night  be  equally  or  nore  inportant  for  success  aboard 
subnarines  than  that  of  a technical  or  Job  knowledne  ssture.  In  order  to  assess 
both  the  technical  and  the  adjustment  aspects  of  performance  in  an  economical 
fashion^  It  had  been  decided  that  some  sort  of  ratings  by  superiors  must  necessarily 
fom  at  least  a part  of  the  criterion  measures  of  shipboard  performance.  Further- 
more it  w&s  decided  that  this  rating  device  should  be  designed  to  tap  as  many 
Important  aspects  of  shipboard  performance  as  was  practical  and  economical. 

The  shipbosTd  rating  scale  finally  developed  was  what  has  been  referred  to  ax 
a wan-toman  scale.  It  was  so  nmed  because  it  permitted,  in  fact  required,  that 

all  men  in  a group  be  rated  at  the  same  time  on  a given  trait,  in  contrast  to  the 

naioritv  nf  ..‘..lult  «cHuire  mat  a given  man  be  rated  on  all  traits  or 

all  items  at  some  point  in  time  before  the  next  man  is  rated.  Thi«  zzt. 

fomat  helped,  it  is  thought,  the  raters  compare  the  various  men  In  their  groups 
and  decide  whether  or  not  Smith  had  more  of  this  ability  or  this  trait  than  Jones 
and,  to  some  extent,  how  much  more. 

Working  with  Naval  personnel  to  obtain  leads  as  to  the  important  shipboard 
behaviors  to  be  included  in  this  scale,  end  later  performing  a factor  analysis  of 
intereorrelations  of  traits  of  the  earlier  forms  cf  the  scale,  the  following  ten 

traits  were  finally  arrived  at  for  inclusion  in  the  final  form  of  the  rating  scale. 


1) 

Cooperation 

6) 

Leadership 

2) 

Knowledge  of  the  Job 

i\ 
, / 

Neiiness  of  Work 

3) 

Discipline 

8> 

Care  of  Equipment 

4) 

Application  and  Initiative 

9) 

Ability  to  Troubieffhoot 

5) 

Judgment  and  C-omaon  Sense 

10) 

Sincerity  in  Dsing  the  Job 
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The  fsctorisi  snaljiii  of  the  predecessors  cf  this  final  scale  had  indicated, 
on  two  separate  occasions,  that  at  least  two  broad  general  areas  of  perforraance 
had  been  rated.  One  of  these  was  characterized  by  high  secret  in  such  traits  as 
Knowledge  of  the  Job,  Leadership,  Ability  to  Troubleshoot  and  the  ratee's  pay 
grade.  This  factor  had  been  regarded  as  primarily  te^nical  In  nature  and  labeled 
at  Technical  Competence.  The  two  traits  having  highest  loadings  on  this  factor 
were  Knowledge  of  the  Job  and  Ability  tc  Trcublcshoot. 

A second  factor  which  had  emerged  in  the  two  Independent  analyses  was 
characterized  by  such  traits  as  Cooperation,  Application  and  Initiative,  Discipline, 
Care  of  Equipment  and  Sincerity  in  Doing  a Good  Job.  This  factor  clearly  seemed 
to  reflect  more  in  the  way  of  adjustment  or  attitude  toward  submarine  life  than  did 
the  previous  one*  It  was,  therefore,  given  the  tentative  label  Personal  Adjustment, 

Hie  reliability  of  the  ratings  abts  itied  with  this  form  was  generally  found  to 
be  satisfactory  both  from  the  standpoint  of  inter-rater  agreement  and  from  the 
•taadpoint  of  rate-rerate  reliability.  Inter-rater  agreement  ranged  from  about  .45 
Iw  ,vZ  ivM.  inaiviauoi  traits  and  better  than  .70  for  total  score.  Hate-rerate 
reliability  measured  over  an  elapsed  period  of  f{v«  tn  ni  **e  f’f’rthr  v.nc  ubvVk  .w. 

Ratings  were  aceotnplisbed  by  three  of  each  man*s  supervisors.  For  the  most 
part,  these  were  the  man’s  division  officer  and  the  two  leading  petty  officers, 
usually  chiefs  of  his  gang. 

At  this  point,  it  is  necessary  to  interject  some  information  about  the  nature 
of  the  men  who  made  up  the  subjects  for  the  rciviainder  of  the  study.  The  two 
largest  rates  aboard  subms- ir.es  of  the  N««y,  in  terms  of  the  number  of  men  aboard, 
were  the  Electrician’s  Hates  and  the  Enginemen.  Since  it  would  have  been  impracti- 
cal to  develop  separate  eriterio.!  measures  for  all  of  the  various  rates  aboard,  it 
was  decided  to  soncentrats  on  these  two  rates  because  of  their  relatively  large 
ntotbers.  Furthermore,  since  our  interest  was  primarily  with  those  men  to  vdiom 
aptitude  tests  had  been  administered  at  New  London,  we  were  confined  not  only  to 


the  tifo  rates  of  Eleetrielaa*s  Mates  and  EagSneAee  but.  *l!o  tc  ralati^eljr  recent 
graduates  of  the  SutMarlae  School, 

It  was  arbitrarily  decided  that  no  nan  would  be  included  in  the  study  who  had 
not  served  aboard  a boat  at  least  six  months,  It  was  presumed  that  his  supervisors 
would  have  had  a reasonable  chance  to  become  acquainted  with  him  In  such  a period 
of  tiwe^  The  gsthering  of  criterion  measures  was  accooqtllshed  mainly  in  the  summer 
of  1991.  This  meant  that  the  subjects  for  study  were,  with  few  exception  Sj  Striker a 
iiid  3rd  Class  Petty  Officers.  They  represented  men  with  from  six  months*  to 
approximately  two  years*  experience  aboard  submarines.  This  selection  of  subjects 
no  doubt  placed  ertsin  restrictions  nn  the  ranges  of  abilities  repre.^ented  and  on 
the  extent  to  which  each  man  might  have  had  an  opportunity  to  acquaint  his  superiors 
with  his  eaptbilities. 

In  the  chart  on  page  42  , the  interrelationships  between  all  predictors  and 
criteria  in  this  study  are  presented.  In  the  first  column,  under  Criteria  of 
Perfomanoe,  the  first  group  of  multini*  r»-  rc.v-li  ibc  cxvenx  xo  which  ratings 
on  the  general  traits  of  the  rating  scale  were  predictable  from  aptitude  test 


Most  revealing  in  this  set  of  relationships,  perhaps,  is  the  lack  of  ore** 
dictability  of  total  score  on  the  rating  scale.  None  of  the  aptitude  tests  showed 
more  than  chance  deviations  from  zero  correlations  for  either  the  Electrician* s 
Hates  or  Enginemea  population.  Since  the  predictors  were  aptitude  test  scores,  it 
was  thought  that  scoras  on  the  tewnicai  traits  of  the  rating  scale  might  be 
predictable  whereas  scores  on  personal  adjustment  traits  might  not.  To  a small 
extent,  this  proved  true.  The  Direction  Harking,  Naval  Mechanical  and  PMA  Reason* 
ing  test,  in  combination,  produced  multiple  R*s  of  .28  and  ,81  for  the  Electrician's 
Hates  ratinnn  or  Kncwisdge  of  the  dob  and  Troubleshooting.  This  relationship  did 
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PREDICTION  AND  MEASUREMENT  OF  PERFORMANCE 
OF  SUBtiMfUrt:  ellctrician's  mates  and  enginemen 


not  hold  up  for  the  Enginenent  hoNever,  niiich  must  be  regarded  as  something  of  a 
failure  of  oross~validation<i 


BatlMi  on  Soeelfie  Job  Tasks 

In  order  to  get  as  close  as  possible  to  specific  shipboard  behaviors  which 
should  be  observable  to  supervising  officers  and  netty  officers,  a second  rating 
scale  had  been  designed  which  also  utilized  the  man-toman  format.  This  consisted 
of  items  of  specific  technical  behavior  in  contrast  to  the  general  traits  contained 
in  the  rating  scale  previously  described.  One  of  these  specific  check  list  rating 
scales  was  developed  for  the  Electrician's  Mates  and  one  for  the  Enginesnen,  The 
items  selected  were  those  which,  according  to  shipboard  personnel,  were  of  an 
appropriate  difficulty  level  for  Strikers  and  3rd  Class  Petty  Officers,  were 
frequently  performed  aboard  ship,  and  which  raters  would  know  whether  or  not  his 
men  could  perform,  For  example,  the  Electrician's  Mates  scale  included  items  such 
as:  "Can  determine  if  a submarine  battery  needs  water",  "Can  replace  a length  of 
ship's  lighting  cable",  "Can  rewire  electric  switches",  "Can  parallel  D.C,  aenera- 
i-ors  using  correct  procedure",  "Can  stand  a repair  watch  in  the  battery  compartment 
during  battle  stations".  ***•'  r*uui  ilic  Engineraen’s  check  list  were: 

"Can  stand  a thrultle  watch  on  the  main  engines",  "Can  cut  and  properly  replace 
packing  on  valves",  "Cnn  line  up  and  start  a main  engine",  "Can  operate  vapor  com- 
pression units",  "Can  make  necessary  adjustments  or  replacements  in  main  hydraulic 
systems",  etc* 

Fifty  such  items  were  selected  after  pre-testing  for  both  the  Electrician's 
UatBS  asd  Esgincaseri.  Again,  the  division  officer  (Engineering  Officer)  and  the  two 
leading  Chief  Petty  Officers  of  each  men's  gang  performed  the  rating.  Inter-rater 
agreement  on  total  scores  for  the  Check  List  rating  scale  proved  to  be  above  .60. 
Some  officer  ratings  had  to  be  discarded  because  the  officers  found  that  they  did 
aot  have  sufficient  specific  knowledge  to  utilize  the  check  list. 
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A«  can  be  aeen  in  the  second  column  of  the  chart  under  Criteria  of  Performancot 
the  specific  check  list  ratings  proved  sostenhat  more  predictable  by  aptitude  tests 
than  did  the  ratings  on  more  general  traits  of  behavior.  The  Navy  Mechanical  test, 
the  Visual  Attention  test,  and  PHA  Numerical  test  combined  to  yield  a multiple  R 
for  both  independent  samples  in  the  neighborhood  of  ,40. 

grittep  Job  Knowledoe  Test  and  Job  Sample  Performance  Tests 

While  ratings  were  easily  obtainable  and,  it  was  hoped,  would  eventually  be 
shown  to  be  suitable  criteria  cf  shipboard  performance,  the  many  questions  usually 
raised  about  their  usefulness  led  to  the  development  of  actual  tests  of  performance 
which  could  be  administered  to  the  subjects  aboard  shin,  As  can  be  seen  in  the 
last  two  coiunnns  of  the  chart  under  Criteria  of  Performance,  these  consisted  of  a 
Written  Job  Knov?ledge  test  of  a conventional  multiple-choice  variety  end  sstusl  Job 
Ss^le  tests  which  required  each  man  to  demonstrate  his  skill  at  selected  tasks 
representative  of  what  the  Electrician* s Mate  or  Engineman  actually  does  aboard 
ship. 

Tiic  blucirician' B m«te  was  tested  on  Control  Cubicle  Operations,  Use  of  a 
Megger,  Circuit  and  Fuse  Testino.  Scur.d  TuMcteti  leiepnones.  Testing 

Storage  Batteries,  Use  of  Hand  Tools,  and  Safety  Precautions  in  connection  with  his 
work.  The  Engineman  was  tested  on  Use  of  Wrenches,  Drilling  and  Threading  a Hole 
to  Fit  a Bolt,  Naming  of  Tools  associated  with  his  work,  Identification  and  Function 
of  Globe  and  Gate  Valves,  Identification  and  Function  of  Air  Compressor  Valves, 
Instrinsent  Panel  Analysis,  and  Safety  Precautions  associated  with  his  work.  The 
performance  test  battery  required  spproximately  two  hours*  a(hnini3tration  time. 

The  reliabilities  of  the  sub-tests  ranged  from  ,50  to  .80  and  the  reliability  of 
the  cos^osite  battery  for  ESl*s  and  EN*g  was  estimated  at  about  ,90, 

The  Written  Job  Knowledge  test  contained  multiple-choice  questions  concerning 
the  practical  and  theoretical  aspects  of  the  Electrician’s  Mate  and  Engineman  Job. 


The  reliabilities  of  these  tests  were  .86  and  .68  respectively.  As  can  be  seen  in 
the  chart,  the  aptitude  tests  predicted  performance  on  these  tests  to  a reasonable 
degree.  The  Navy  MoCheniOBl  and  navy  Arithmetic  tests  combined  to  give  multiple 
n*s  of  .47  and  .34  for  the  electrician's  Mates  total  score  and  Enginemen  total 
score  respectively. 

More  interesting,  perhaps,  is  the  extent  to  which  the  Navy  Mechanical, 
Guilford-Zinmerman  Mechanical  and  Direction  Marking  tests  combined  with  Vorbsl 
Fluency  (for  the  Electrician's  Mates)  snd  Social  Science  (for  the  Enginemen)  to 
yield  multiple  R's  of  ,62  and  ,56  for  the  Electrician's  Mates  and  Enginemen' s 
average  performance  test  scores  rcspcativsly.  No  parilcuiar  hypothesis  is  advanced 
to  explain  the  presence  of  the  two  verbal  tests  of  these  batteries.  Their  contri‘> 
bution  to  the  total  was  relatively  small.  However,  the  presence  of  the  Navy  Me- 
chanical and  the  Siiection  Marking  tests  which  had  proved  predictive  of  both 
general  and  specific  ratings,  and  Virltten  Job  Knowledge  test  scores  as  well, 
established  some  confidence  that  tests  of  this  type  are  valid  for  ^nany  of  the 
technical  asoeetn  nf 

Submarine  School  St«wdim<  « Predictor 

Submarine  School  Standing  appears  to  be  a reasonable  predictor  of  subsequent 
performance  aboard  submarines.  iVhile  the  relationships  shown  in  the  second  row  of 
the  chart  are  not  particularly  high,  it  must  be  remembered  that  we  had  dealt  with 
a relatively  restricted  range  of  performance  in  confining  the  study  to  3rd  Class 
Petty  Officars  and  Strikers,  It  is  considered  quite  possible  that,  had  the  careers 
of  these  men  been  followed  until  they  became  2nd  Class  or  1st  Class  Petty  Officers, 
the  relationship  of  Submarine  School  Standing  to  subsequent  performance  might  have 
Braved  higher. 

In  observing  the  relationships  between  Submariue  School  Standing  and  the 
criteria  developed  for  this  study,  a trend  can  be  observed  that  was  generally  true 
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of  all  the  relationthipii  determined.  This  ia  the  fact  that  relationships  between 
predictors  and  criteria  were  generally  higher  for  ths  Electrician's  Mates  than  for 
the  Enginenen.  Submarine  School  Standing  predicted  Electrician's  Mates  Job  Knowl** 
edge  to  the  extent  of  .90,  Troubleshooting  ,29,  and  Total  Score  .26.  In  contrast, 
it  predicted  Enginenien  Job  Knowledge  only  .21,  Troubleshoot  in-;!  .17,  and  Total  Score 
.IS. 

The  same  trend  can  be  ctserved  in  the  correlation  between  ^bmarine  School 
Standing  and  specific  check  list  rating  (.35)  for  Electrician's  Mates  and  only  .20 
for  Enginemen.  Again,  the  trend  can  be  observed  with  the  Written  Job  Knowledge 
ieit,  the  correlation  being  .33  for  Electrician's  Mates  and  .16  for  Enginemen. 

When  it  came  to  total  score  on  the  Job  San|)le  performance  tests,  however,  Submarine 
School  Standing  proved  to  be  equally  valid  for  the  two  rates,  the  correlation  being 
.40  in  each  ease. 

This  general  trend  toward  greater  validity  for  Electrician's  Mates  ratings 
is  believed  to  be  due  to  the  fact  that  the  Electrician's  Mate  freouentlv 
Ittwlevwu,  ratner  specific,  and  comparatively  easily  observed  tasks.  He  much  more 
frequently  works  alone  than  th  C * a*  OMlOII  • usually  works  in  a fairly  con- 

fined area  or  on  a relatively  small  piece  of  equipment.  The  Engiaeman  in  contrast, 
particularly  at  the  Striker  and  3rd  Class  levels,  tends  to  work  with  others  on 
highly  complex  and  large  pieces  of  machinery.  It  is  quite  possible  that  the  extent 
of  his  contribution  to  the  totel  psrfo7«iar<ce  is  relatively  difficult  to  evaluate 
because  he  so  often  performs  as  a member  of  a team  with  a great  deal  cf  help  and 
direct  supervision  from  others, 

ReUtioashlp  of  Batinos  on  General  Traits  to  Other  CrlterinaLMeesurgg 

In  the  third  row  of  the  chart,  the  extent  of  relationships  between  ratings  on 
the  ten  general  traita  end  th«  other  criterion  measures  can  be  inspected.  It  will 
be  notSeed  first  of  all  that  thert  were  aaoderately  high  reletioaships  between 
ratlags  on  the  gonfrhl  trait  ratima  aeoi*  end  ratings  on  the  specific  check  list 


rating  scale.  Total  scores  on  these  measures  correlated  .58  for  the  Electrician* s 
Mates  and  .49  for  the  Enginasen.  Scores  on  the  general  traits,  Knowledge  of  the 
<3ob  and  Troubleshooting,  correlated  .47  and  .43  with  the  total  check  list  scores 
for  the  Electrician's  Hates  and  and  ,32  for  the  Enginemen.  It  was  generally 

observed  throughout  the  study,,  as  might  be  expected,  that  the  two  different  kinds 
of  ratings  correlated  higher  with  each  other  than  either  did  with  any  other  measure. 

It  will  be  noticed  in  the  next  column  that  ratings  on  Knowledge  of  the  Job  and 
Troubleshoot ing  ccrrelsted  to  some  extent  wlih  Written  Job  Knowledge  test  scores. 
These  correlations  were  .25  and  .32  for  the  Electrician's  Hates,  .32  and  .36  for 
the  Enginenen.  The  correlation  of  i^itten  Job  Knowledge  test  scores  with  Total 
Score  on  the  general  rating  scale  was  considerably  lower,  dropping  all  the  way  to 
.05  for  the  Electrician's  Mates  and  .20  for  the  Enginemen. 

Finally,  the  relationship  of  scores  in  the  general  rating  scale  traits  to  the 
Job  Sample  test  scores  can  be  seen  in  the  last  column.  The  picture  here  is  en- 
couraging in  the  case  of  the  Electrician's  Mate  but,  unfortunately,  discouraging 
in  the  case  of  the  Engineman.  Ratings  on  the  traits  Knowledge  of  the  Job  and 
Troubleshooting  correlated  .48  and  .39  with  total  Job  Sample  test  scores  for  the 
Electrician’s  Mnt.ns.  ir.  ty  tl;c  pay 

grades  of  the  men  in  the  study,  this  is  a fairly  substantial  result.  For  the 
Enginemen,  however,  the  correlations  for  the  same  two  traits  dropped  to  ,16  and  .23 
resDectively.  Again,  the  hypothesis  is  advanced  that  the  general  nature  of  the 
Engineman  Job,  at  the  level  studied,  made  it  rather  difficult  f.?r  raters  to  know 
just  how  much  in  the  way  of  technical  ability  the  Enginemen  really  possessed. 

Belationthip  of  Specific  Check  List  Ratings  to  Other  Criteriott  Measures 

In  the  fourth  row  of  the  chart,  it  will  be  observed  that  the  more  specific  and 
technical  cheek  list  ratings  did  not  fare  very  much  better  in  their  prediction  of 
performance  on  Job  Sample  end  Written  Job  Knowledge  tests  than  did  the  technical 
traits  of  the  genial  aeale*  Total  scores  on  the  check  list  rating  scale 
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eorreitted  .40  wltfi  total  scores  on  the  liritten  Job  Kaxwledge  tests  for  ElectrlclsnV 
Hates  but  only  .26  for  the  En^lnu&en. 

Since  the  check  list  ratings  represented  the  ratersi*  opinions  of  the  ability 
of  their  Men  to  perfons  inportnnt  job  tasks,  « soaefriiat  exhaustive  study  was  per- 
formed of  the  relationship  between  these  ratings  and  performance  as  revealed  by 
the  Job  Sample  tests.  First,  check  list  scores  Were  taken  as  absolute  values  and 
correlated  with  Job  Sample  performance  test  scores.  This  procedure  resulted  in  a 
correlation  between  the  two  netsaret  of  ,37  for  Electrician* s Mates  and  .27  for  the 
Snglnemen. 

Thie  fnmewhat  surnrisinoly  low  relationship  was  ihOuyh  I possibly  to  be  due  in 
part  to  differences  in  the  leniency  of  raters  in  the  various  submarines  that  were 
included  in  the  sample.  Therefore,  the  rank  order  of  each  man  within  his  own  boa\ 
on  the  performance  test  was  correlated  with  his  rank  order  or.  the  check  lift 
ratings.  The  average  rank  iirder  coefficient  obtained  over  about  a dozen  subnerines 
was  .52  for  the  Electrician's  Mates  and  ,30  for  the  Englnenen.  In  the  case  of  the 
Mat««  «t  tM«  orocedure  seemed  to  increase  the  validity  of 

the  check  list  ratings  tc  a point  where  they  might  be  considered  to  yield  a reason- 
sble  indication  of  technical  skill  where  Job  Saisple  test  scores  are  considered  a 
good  criterion  of  those  ekills. 

In  order  to  shed  further  light  op  the  validity  of  raters'  opinions  about  the 
skills  of  their  men,  items  from  the  cheek  list  ratings  which  were  identical  with, 
or  similar  to,  sub-tests  in  the  performance  test  battery  were  correlated  with  scores 
on  their  counterparts  in  the  performance  test.  The  median  correlation  between  rated 
ability  to  da  a task  and  tested  ability  to  do  the  same  or  a very  similar  task  was 
,16  for  both  Enginemen  and  Electrician's  Mates.  Tnis  strongly  suggests  that  most 
raters  in  this  study,  in  spite  of  the  fact  that  they  lived  with  their  men  24  hours 
8 day,  dlld  not  have  very  much  knowledge  of  whether  or  not  their  men  could  actually 
perform  soecific  tasks  which  were  regarded  as  important  parts  of  the  Electrician's 
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Kate  and  Engineman  Jobs,  lHiile  total  scores  on  the  check  list  did  have  some,  and 
perhtt>8  a usable,  vaiidjlty  jin  predicting  total  scores  on  Job  Sample  tests,  the 
statement  on  the  part  oi  a rater  that  his  men  can  or  cannot  do  a specific  task 
must  be  regarded  vfith  some  suspicion. 

BaIatlQEUihiitf_Between  Written  Job  Knowledge  Test  Scores  and  Job  SaiaDLe_Perforfn.flnS£ 

Sftorgt 

Finally,  in  the  last  row  of  the  chart  can  be  observed  the  extent  to  vdiich 
scores  on  the  multiple-ciioice  Written  Job  Knowledge  test  correlated  with  total 
scores  on  Job  Semple  tests.  The  magnitude  of  the  correlations  obtained,  .46  for 
Electrician* s Mates  and  .35  for  Enginemen.  would  hardly  lead  one  to  accept  Written 
Job  Knowledge  test  results  as  a substitute  for  whatever  is  meabured  by  actuai  Job 
Sasfflle  tests. 

This  general  magnitude  of  correlation,  in  the  neighborhood  of  .40,  was  about 
the  same  as  the  extent  of  the  correlation  observed  among  the  various  parts  of  the 
performance  test  battery  itself.  This  raises  some  interesting  questions  as  to  how 
many  Job  Sample  tests  one  would  have  to  assemble  to  cover  completely  the  technical 
100  SKiJUiB  wnscn  navy  men  oi  a given  rttie  are  :>uppu»eu  t-u 

additional  questions  about  the  amount  of  specific  variance  associated  with  the 
Job  Sample  sub-tests  and  whether  or  not  there  are  general  skills  which  might  be 
measured  wfciich  would  be  independent  of  the  specific  materials  or  equipment  associ- 
ated with  a given  task.  It  also  raises  questions  concerning  the  extent  to  which 
training  and  subsequent  spsciaiization  aboard  the  submarine  will  limit  the  relation- 
ship between  Jab  Sample  tests  of  all  types. 
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CqiicIusIob* 

The  following  eoncluiions  are  drawn  from  the  results  of  this  study: 

1»  Scores  fron  a battery  of  aptitude  tests*  including  aiechanical* 
arithnetiCi  and  direction  sarking  type  tekts,  will  predict  to  a 
large  extent  the  reliable  variance  in  the  Subaarine  School  criterion^ 

2.  Scores  from  a battexy  of  aptitude  tests,  including  mechanical* 
arithmetic*  reasoning*  visual  attention,  direction  marking  and 
possibly  verbal  tests*  will  predict  to  a moderate  extent  the 
technical  aspects  of  shipboard  performance  as  measured  by  Job 
sample  tests,  written  Job  knowledge  tests,  and  specific  check  list 
ratings* 

3.  A large  part  of  the  variance  in  ahipboard  ratings  of  performance 
appears  to  be  non-technical  in  nature,  suggesting  that  ratings 
measure  to  some  extent,  attitude  toward  the  Job  or  adjustment  to 
Navy  life. 

4.  Aptitude  test  scores,  of  the  type  employed  in  this  study,  apparently 
rrlll  Mvi.  (fueulut.  ihe  non-tecnn^cq/i  aspects  of  performance  measured 
by  thg  rististgs* 

5.  Submarine  School  standing  appears  to  be  a fair  predictor  of  subse- 
quent  shipboard  performance  as  measured  by  job  sample  tests 

and  ratings* 

6.  In  this  study  the  performance  of  Electrician's  Hates  was  more 
reliably  measured  and  better  predicted  than  that  of  Enginemen* 

This  suggests  that  the  factor  of  rate  may  play  a major  role  in 
determining  the  type  of  criterion  measure  that  can  be  used  and  the 
extent  to  which  it  will  be  predictable  from  other  measures*  (For 
example,  the  fact  that  Enginenen  tend  to  work  in  small  groups  and 
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on  large  pieces  cl  equipment,  in  contrast  to  Electrician* s Kates 
tvhc  rrequentiy  «fo>k  alone  and  on  smaller  pieces  of  equipment,  is 
believed  to  aake  **  mre  difficult  for  an  observer  to  judge  the 
skill  and  knoKledge  of  a particular  Engineman.) 

Scores  from  written  Job  knowledge  tests,  as  developed  for  this  study, 
do  not  correlate  high  ^enough  wilh  job  sample  test  scores  that  written 
test  results  can  be  accepted  as  a satisfactory  indication  of  a 
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NEW  LONDON  INTERCORRELATION  MATRIX 
(Tetrschoric  Coefficients! 

N = 475  For  Variables  1-20,  24-27 
N = 319  For  Variables  21-23 
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NEH  LONDON  INTEP.CORRELATION  MATRIX  (cont.) 
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NEW  LONDON  BATTER>f 
CENTfiOlD  FACTOR  MATRIX 
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